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ABSTRACT 



This guide provides assistance to state and local 
vocaLional -technical educators in the development of curriculum that is based 
on national and state skill standards that use workplac e-derived measures of 
competent performance to prepare students for the work world. The guide 
begins with guidelines for determining the usefulness of existing standards 
sets, including criteria for evaluating their validity, the performance 
indicators used, the credibility of the developers, and civil rights 
concerns. The following typical steps in the process of developing 
standards -based curriculum are then discussed: (1) conduct a needs analysis; 

(2) obtain a set of national, state, or business -industry skill standards; 

(3) establish a program advisory committee; (4) review the skill standards 
set to identify vocational- technical program content; (5) develop an 
assessment process and instrum(mtation; (6) develop, adapt, or adopt 
instructional materials; and (7) review and revise curriculum on an ongoing 
basis. The last section of the guide describes how to develop scenario-based 
instruction through the use of a scenario planner and development and review 
rubric. Appendixes contain sample skill standards, model scenarios, a 
checklist for instructional and assessment criteria, a sample scenario 
planner, and a blank master. (Contains 22 references.) (KC) 
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Executive Summary 



In the 1990s, skill standards initiatives at the liedcral level have been spurred by 
the National vSkills Standards Projects sponsored by the U,S. Departments of 
Hducation and Labor and the establishment of the National Skill Standards 
Board in 1994. However, the standards movement in the United States includes 
more than 25 years curriculuin development by state curriculum centers and 
numert)us curriculum projects and proj^rams. This paper was developed to 
provide assistance to state and local vocationahtechnical educators in the 
development of curriculum based on national and state skill standards. It pro- 
vides guidance and models for usin^ these workplace 'deri\'cd measures of com- 
petent performance in the preparation of students for the world of work. 

The paper bet^ins with guidelines for determining the usefulness of existing 
standards sets, including criteria for evaluating their validity, the performance 
indicators used, the credibility of the developers, and civil rights concerns. The 
typical steps in the process of developing standardsdiased curriculum are dis^ 
cussed: 



• Conduct needs analysis 

• Obtain a set of national, state, or businessundustty skill standards 

• Establish program advlsoi7 committee 

• Review skill standards set to identify' vocationahtechnical prtigram ctmtent 

• Develop assessment process and instrumeniatic^n 

• Dcvclop/adapt/adopi instructional materials 

• Review and revise curriculum on an ongcung basis 

Derived from the real world, skill standards provide a natural content base tor 
contextual instruction. StandardsTased scenarios provide a rich context for the 
integration of academic and vocational educatitm. The last chapter describes 
henv to develop scenario-based instruction through the use of a scenario planner 
and development and rc\'iew rubric. 

The appendices contain sample skill standards, model scenarios, a checklist for 
iiistructional/asscssmcnt criteria, a sample scenario planner, and a blank master. 

Information on using skill standards for curriculum dex'clopment may be found 
in the ERIC database using the folknving descriptors: Competence, Criterion 
Referenced Tests, ''^’Curriculum Development, '"Job Skills, '^’National Standards, 
’^Performance Based Assessment, ’‘'State Standards, and Vocational Education, 
and the identifier ’^'Scenarios. Asterisks indicate Jcscripu^rs that arc particularly 
relevant. 



Introduction 



The stanJiirds construcr has achicx'cd a life ol its own during the 1990s, The 
collaborative efforts of business and industry im)^j[uls and state governors to 
impnwe academic performance and internatit)nal competitiveness have resulted 
in a plethora of standards of all kinds and of varying quality. Tliere are two types 
ot education and training standards, those dealing with student academic skills 
and chose that address occupational skills (broad or narrow) relating to work 
requirements. In this monograph, standards that address wt)rk"relatcd skills are 
labeled skill standards. 

Standards devek^pers include the National Skill Standards Board (NSSB) con- 
vening groups at the federal level, state -level groups setting academic and skill 
standards, and local developers of academic standards. Numerous piihlications 
address the multiplicity of academic standanis. For those with an interest in 
learning more ahotit the status ot the academic standards movement, the U.S. 
Departm''nt of Education’s regional education labs such as the Mid-Continent 
Research for Education and Learning Laboratory (MCREL) <http:// 

\^'ww. mcrel.org/> and the Northv'est Regional Educatiem Laboratoiy (NWRJiL) 
<htrp://vvww.nwrel.org/> have extensive information on academic standards 
initiatix'es as well as links to other pertinent sites. Inlormation on all ongoing and 
past academic standards initiatives can be located through these centers. 

The term “skill standard” has suiiaced relatively recently as a locus oi stale and 
national efforts. Prior to these initiatives, although standards of competent skill 
and task performance were identified and used in curriculum development, skill 
standard terminology was not used in the development of vocational-technical 
education curriculum. The concept of standards, hc'»wever, has been in place in 
educatit)n and vocational-technical education since the 1960s. Most ediicauu's 
would recall these early standards initiatives as behavioral or performance 
objectives like thevse established by Magcr (1962). Behavioral objectives include 
the performer (a student), the action or behavior (a task or skill), and the crite- 
ria for competent performance of flic behavior (a standard). 

Skill standards initiatives at the federal level began with the 22 National Skill 
Standards Projects sponsored by the U.S. Departments of Education and Labor 
in 1993. The results of these projects arc sometimes called national skill stan- 
dards, but this is true only if they are endorsed by a recognized national business, 
industry', or labor organization. 

The major national activity in this field was tlie establishment oi the National 
Skill vStandards Board (NSSB) in 1994. The NSSB represents business, labor, 
employees, education, and community and civil rights organizations overseeing 
the dex^elopment of a voluntary national skill standards system, including assess- 
ment and certification. The NSSB docs nt)t develop or endorse standards. This 
work is actually ct)nductcd by grt)ups of individuals called convening groups, 
which will es'-ahlish “voluntary' partnerships” that reflect the organization of the 
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Introduction 



hciard. ITiosc ^^oluntary partnerships are the national standards cndorsinj^ entity 
under tlie KISSB umbrella. The convenin^^^ groups are diarized with identifyini^ 
standards for the “core” and at least tme “concentration” area. For lurther delini- 
tions and inlormation on the activities of the NSSR and the present status and 
luimhor of voluntary partners! lips, see their wehsite 
< http://www.nssh. or^/> . 



In addition to activities at tlie national levch die standards niovemeni at the slate 
level includes more than 25 years of curriculum dcvck^l^ment hy state ciirnculum 
centers and numerous curriculum development projects and programs. Numerous 
materials in the ERIC database and other publications document these activities 
in the United States anil internationally. One example of a lon^,^'terni standards 
development group, the VocationaUTcchnical Education Constutium of States (V- 
TECS), has analyzed occupations since 1973, identifying tasks and standards that 
are used for vocational curriculum development hy niemher and nonmemher 
states. 



Skill standards are generally associated with an industiy^ or occupation, or some 
subset or combination of these. For many years, skill standards have been and arc 
being developed hy business, industiy, and labor organizations identifying worker 
skills in specific occupations. Wclbknown examples o( this type ot standards 
include the National Institute for Automotive Service Excellence (ASE) stan- 
dards f(^r automotive technicians, the American Welding Society (AWS) stan- 
dards for welds made hy certified welders, and numerous apprenticeship stan- 
dards. 

For the purpcxscs ot this monograph, a skill standard is defined as follows: 

an operati(Mial definition of competent porforniance, stated in such a 
fashion that an expert in the area ot interest can determine competent 
\'s. noncoinpetent performance, and peers agree on the judgment of the 
expert. 'Fhe stated level of performance must not be ambiguous, and 
experts in the area must he able to understand the statement. 

Academic standards have been and arc being developed at the national, state, 
and local level Examples of national academic standards include the Curriculum 
and Evaluation Standards for School Mathematics, published by die National 
Council of Teachers of Mathematics in 1989, and the efforts of the National 
Science Teachers Association and the American Association for the Advance- 
ment of Science standards initiatives. Other national academic standards have 
been produced hy various groups, with mixed results. Nearly all states have estab- 
lished state academic content standards, and many have an associated assessment 
process. 




One of the premier organizations working in the academic standards arena is 
MCREL. The work of researchers in that organization relating to national, state, 
and local academic standards is exemplary. On their website < http:// 
vvwav.nicrel.org/standards/> are numerous materials relating to academic stan- 
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JartLs, with The Fall and RL^e of Standards-Based Education, by Rohen J. 
Marzi\i)o aiul John S. Kendall (19QQ), pnn’itlin},; an excdleni o\'cr\'ic\v ihe 
slandarJs incn'enieni in ediicalinn and idcMn ifyin^ ilu; bij^nificaiu challcn^^es in 
iinplcinenvin)( a siaiidards'hased delivery sysiem at the sehool level. Spv( itieally, 
they Male; 

In short, a stale, sduu)! or district ^vl^i!ln^ to establish standards based 
on the national documents nuist lirsi identily what they mean by a 
standard and the format their standards will take. Next, they must 
systematically analy::e all the national documcMUs iranslatin}.nhom into 
a ttnanai and conceptual base compatible with their own. d'his, o( 
course, can be a labor-intensive endea\’or that requires valuable re- 
soitrccs of a variery of types, (p. 32) 

Their discussion n( various types of standards is very helpful to practitioners 
attemptint^ to differentiate them. As an example, in their discussion of content 
and performance standards they state: 

In other words, a content standard is a statement of the knowled^^e or 
undenstandinj^ we would expect students to have. On the other hand, a 
perlormance task describes a specific use ol krunvleJi^e and skills: it is 
no{ a description of knowledj^e, but a description of some application of 

it. (p. 3«) 

rhey on to quote the National Hducarion Standards and Improvement (2oun- 
cil (NHSIC;): 

As the National Education Standards and Impro\'ement Council 
notes.,.. performance standards indicate “both the nature of the evi- 
dence (such as an essay, mathematical proof, scientific experiment, 
project exam, or combinatioii of these) required to demonstrate that 
content standards have been met tind the quality of student perfor- 
mance that will he deemed acceptable” (NESIC 1993, p. 22). (p. 40) 

The advice of Marzam> and Kendall (1999) relative to definitions and formatting 
certainly pertains to the use of skill standards in the de\'clopmcnt of vocational- 
technical curriculum, as is discussed in the next section of this mono^Taph. In the 
skill standards arena there are sii^nificant definition issues, and the user of skill 
standards must be aware of these caveats. 

The standards arena can be quite confusing to individuals who do not dewlop or 
use randards on a rettular basis (and unfortunately, in many cases, it can be 
confusing to all but the developer of the standards set under review). The next 
section of this monograph includes discus.sicm and criteria to help irregular users 
of standards sort through standards quality issues. As in most fields, the u.se of 
terms conveys specific meanings to experienced skill standards developers. The 
skill standards movement has led to a plethora of skill standards developers, some 
more experienced than others. This has resulted in the use of the same term with 
multiple meanings, with “standards” being the most problematic. 
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Many aiUhoi: standards dcvclupmeni activities liavc occurred during tlic past 20 
years, includin|^^ business and indiisti^ materials, national efforts, aiul some sif^mifi- 
cant slate initiatives. As in talicr arenas, states have developed unique approaches 
to standards development, resulting' in cutriailuiu and standards that have (in 
many cases) quite dillerent approaches to the ct)ncept of a "standard. “ hor potem 
rial standards users, a quality checl list is incltkleLl for the review of standards sets 
to determine their lUiliiy for instructional material development. 

Skill standards are generally associatal with skills required hy workers on the joh 
in husincss and iiuliistty, as opposed to academic standards for student perform 
inance, although there is a significant interrelationship between acatlemic and 
skill staiulards. In atidiritm to technical considerations relating to standards use in 
curriculum development, this monograph provides specific guidelines and models 
for developing student use materials from skill standards. 
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Caveat Emptor— 

D^steftni 111119 th@ ysg^fuiii^ss 

of Skill Standards 



Ii would he lielphil 10 readers ol this mononrapli and users ol skill standards ii 
ihcre were a taxonomy or other definiti\'e, commonly accept cil set of definitions 
ol skill standards, standaixls based, stamlards movement, standards sets, and 
other standards-related terminolo^(y. However, no such commonly accepted 
definitional toed exists. Fc^r new itsers, as well as those who have been involved in 
de\’clopirm skill standards or iisin^ skill standards for curriadum de\'e!opmenr, 
this can be confusint^. 

Skill standards, however, come in many sizes and shapes, have no consistent 
definitional base, and include di\Trse degrees of ccmrcnr. vSkill standards arc 
generally, hut nen always, developed with ini>ut from individuals representing 
business and indiisti^, ta'ganized labor, and ediicarion/training. Some skill staii" 
dards have all of these stakeholders represented, some do not. Some skill stan- 
dards are developed by individuals that are experienced in skill standards devel- 
opment, most are not. ’I'hcrcha’e, caveat empUu’ let the buyer (user) beware. 

Tliis section identifies and discusses elements and issues the curriculum deveb 
oper must arv'nd to prior to adopting any .set (organized collection ot skill stan^ 
dards that are related in a meaningful manner) of skill sianilards. 

Vg^hat Is a Skill Standard? 

As indicated earlier, there is no common, universally accepted definition of a 
skill standard, nor common usage of the term standard. Many definitions (d a 
skill standard exist. Pearlman (1997), writing in Iransitions in Work and Learn- 
ing, states that — 



Skill is not a unitary concept. In fact, there is curremly no single, 
generally accepted definition of “skill” in the prcfiessional or scientific 
literature. The term has been used to refer to a uadc range of personal 
characteristics, traits, work preferences, broad apritudes, basic abili- 
ties, generic ccunpetencies, specialized skills, and specialized knowl- 
edge, creating a contemporaiy tenver ol Babel in that the same terms 
are often used to denote different classes (d skills and different terms 
arc often used to denote the same classes of skills. This lack of an 
accepted vocabulary' or a “commons skills language” has been a major 
obstacle to developing appropriate strategics for addressing many 
critical skills issues, such as transferability', gaps, and the setting of 
standards, (p. 143) 
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Klein, Cuccaro-Alamin, Hoachlandcr, Giambattista, aiul Waal (199?) observe: 
Presently, state policymakers and industry' ^’roups are usin^ a variety of frameworks 
to define skill standards. Additionally, inconsistencies in standard format and 
specificity' and a lack of supporrin^^ macerials for educators often result in a failure 
to readily translate skill lists into classroom practice, (p. 2) 

Among the groups defining skill standards, and one that would he expected to 
have an impact on the definitional discussion, is the National Skills Standard 
Board (NSSB). The NSSB (1998) defines skill standards as — 

The array of work' and worket'oriented information that specifies the 
critical work functions, key activities, performance standards, skills, anti 
knowledge required to successfully perform in a given occupation or 
field, and which includes an assessment plan specifying the typ^e and 
level of performance required for certification on the skill standards. In 
simple terms, a skill standard specifics what one needs to be able to do 
and how well one needs to he able to do it. (p. 65) 

According to Pearlman (1997): 

The basic concept of a skill standard implies a translation or an assoc ia^ 
tion between a given skill level of a person and a given performance 
level on a job. This implies the need for a number of things, such as the 
following: (1) definition of the target performance (task or skill cluster) 
to which a skill standard will he addressed (with special considcratiem 
given to the narremmess or broadness with which such performance is 
defined), (2) determination of the worker attributes related to pcrkir' 
mance of the defined task or task cluster, (3) reliable and valid means 
of measuring performance on the defined task or cluster, (4) reliable 
and valid means of measuring the performance "related attributes, (5) 
specification of various levels of performance against which the perfor" 
mance 'related attributes vvill he benchmarked, and (6) specification of 
the levels ot performancc'related attributes associated with these 
performance levels, (p. 168) 

While discussing standards and different rypes of standards, the authors of CrosS' 
lndusti 7 Assessment and CertiHcation (NatitMial Skill Standards and Assessment 
Collaborative 1998) state that — 

A standard is an explicit statement that clearly defines the knowledge 
and skills and the level of pcrktrmancc expected of an individual in a 
given anitent or work area. As a set, standards represent consensus 
among stakehoklers on what is most important for individuals in a field 
(of study or work) to knenv and he able to do. (p. 16) 

They alsc^ identib’ twe^ diftorent types oi standards, ctmteni standards and perfiu*' 
mance standards: 
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Content standards identify the areas of knowledge, understanding, ai'id 
skills which arc expected to be learned by individuals in key subject 
and career areas Performance standards define and illustrate levels of 
expected accomplishment with respect io one or more content stan- 
dards, (p. 17) 

From these definitions, one would C(Micludc that a skill standard must include 
both content and performance elements. 

According to Klein ct ah (1997): 

This confusion about terminology is contributing to the development 
of inconsistent national and state indtisti^ standards. To date, sran- 
dards chat have been defined varv' in their breadth and specificity, 
meaning that industry skills often have few similarities, across, and 
sometimes within, states, (p. 3) 

Given this variance, specific questions relating to the validity of any given set of 
sStandards have been developed for this paper, along with a matrix checklist in the 
next section. 



Caueatm 

Emptor^ 



is the Standards Set Valid? 



Validity is a critical characteristic of standards that are to be used for education/ 
training and certification purpexses. Historically, validity concerns have been 
related to testing and measurement, hut the concept also affects the development 
prcKess t(^r skill standards. 

The NSSB (1998) provides the following definition ol validir/: 

Genetically, the degree to which inferences bavSed on scores from an 
assessment are accurate. There are a number of professionally rccc^g- 
nized forms of validity and methods for gathering and documenting 
evidence of validity including content validity’, criterion-related (pre- 
dictive and concurrent) validity', and construct validity. Content valid- 
ity' refers to evidence that an assessment represents an adequate sam- 
pling of the performance, skill, or area of kncnvledge to which it is 
targeted; such evidence is established on the basis of various character- 
istics of the assessment tool development process itself. Criterion' 
related validity' refers to evidence that assessment scores arc empirically 
related to one or more relevant or important components cT work 
performance. Construct validity' refers to evidence that an assessment 
measures one or more inferred worker traits ov other characteristics 
shown to he important (or effective work performance, (p. 66) 



¥oy skill standards purposes, cemtent validirc is the only concern. Content validity 
is established by documenting the process followed in developing the standards 




14 




|Cac/eaf 

^Empiof 



and by ensuring" that the cc')ntent of the standards accurately reflects the domain 
(occupation, cluster, or industry’) of interest. 

Decision criteria: Docuniencation from the skill standards developer 
must assure that the skills represented in the set were reviewed and 
approved by adequate numbers of expert workers (at least 50) in the 
occupation(s) represented by rhe standards. 

Shill Standards Performance Criteria 

Does the standard set clearly indicate (for each skill) the determinants of coinpc' 
tent performance? A standard, by delinition, identifies what does or docs not 
constitute adequacy. In the case of a skill standard, the standard must identify' 
evaluation criteria to determine an acceptable level of performance, or in some 
instances, indicators of noncompotent performance. If no standard of performance 
is apparent, then clearly, there is no usable “skill standard." 

There continues to be much discussion of exactly how' to indicate levels of perfor' 
mance, including is.sues related to time required to perform, quantity of perfor- 
mance (product or proces.s), and “quality" of performance (the most difficult ro 
define). In any case, a skill standard, for purposes ot this discussion, must relate 
“an operational definition of competent performance,” stated in such a fashion 
that an expert in the area of interest can determine competent vs. noncompetent 
performance, and peers agree on the judgment of the export. The stated level of 
performance must not he ambiguous, and once again, experts in the area must be 
able to understand the statement. 

Decision criteria: Skill performance determinants must be included in 
the skill standards under review, stated to such a degree that a valid 
performance assessment can be developed for skills in the standards set. 

It not, the standards set is of limited value, and the curriculum devcl- 
c>per will need to continue the review of standards sets from other 
developers. 



Ash the Right Questions— Ask the Right People 




In many instances, it is assumed that if the standards set gives an indication of 
having been dc\‘cloped and validated by business, industry, and labor representa-' 
tives, it automatically means that the standards are of high quality' and valid. This 
conclusion, one based on conventional wisdom, is not necessarily accurate. Skill 
standards generally reflect the skill, kncnvledge, and analysis experience of the 
individual leading the standards development project, not the validation group. 
Standards statements can be long or short, have much or little content, perfe^r- 
niance can take very little or a very long tinic, and numerous other elements come 
into play during the standards development process. Each standard must be 
essentially the same “size,” or cemtain a like amount of performance content. 
Standards that include multiple periormanccs are very difficult to measure, given 
the complexity of the required assessment. 





Standards developers who ask business, industry, and labor representatives to 
validate the standards sets may not realize that, although incumbent workers may 
indicate that a skill is performed, the workers have no intrinsic way of knowing 
whether the skill is comparable in content to other skills. One of the primar/ 
problems is attempting to identify’ a standard for a skill when the skill is only a 
perfi^rmance element in another standard, Occupational analysis and group 
leadership skills are critical elements of the standards development process. Many 
state and local skill standards sets (primarily task lists) are developed using the 
DACUM (Developing a Curriculum) process, and skill and experience levels 
among DACUM analysts vary greatly. 

Incumbent workers, those presently working in the occupation, are the only ones 
who actually know and can provide information on the skills performed hy work' 
ers in the occupation or industry and on the associated levels of acceptable 
performance. However, they must be led through a series of group questioii'and' 
answer processes to determine if the standards are adequate. In most instances, 
vocational instructors should not be identified as part of the skills standard 
development team, since they find it difficult to differentiate betwvcn the work- 
based skill and how it is taught in their class. 

Decision criteria: The skill standards set must include infomiatlon on 
the standards development system followed during the development 
process, and should have information on the developers experience, If 
evidence of developer experience is nonexistent or weak, then experts 
in the occupational area need to be consulted to determine if the skill 
standards set is use.ul as a valid base for curriculum development. 

Civil Rights Co :;ern$ 

Curricula developed using standards or any other resources must ensure rhat 
individuals’ civil rights are not violated by implementation of the resulting cur- 
riculum. Racial, cultural, or gender bias must not be apparent in the skill stan- 
dards set. 

Decision criteria: Ensure that the standards have no reference to race, 
color, creed, national origin, or gender. 



Caveat% 

Emptor^ 
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Caveat 

Emptor 



Skill Standards Check 

Skill Standards Set Characteristic 



1st 



1. Skill Standard (SS) sec is endorsed hy 

appropriate business/indiistn^. 

2. Each SS skill includes specific standards of 

acceptable skill performance. 

3. SS set development process is documented. 

4. Number and types of incumbent workers 

participating in the SS set development and 
validation are indicated. 

5. An Internet address is included for further 
information on and updates of the SS set. 

6. SS set is not biased. 



Yes 



No 



Appendix A includes sev^eral examples of skill standards that have been de\^4oped 
by various entities. These are not all good examples of skill standards. They do. 
however, demonstrate the difficulty in obtaining high'Quality skill standards that 
curriculum developers can readily use to develop instructional materials for 
student use. One of the major difficulties with many skill standards is the lack ot 
pcrfomiance standard criteria. Without specific criteria, the standards simply 
become a list of skills, generally mixed to a degree that precludes the development 
of related performance assessments. If item number two in the checklist is missing, 
then the curriculum developer is advised to look for a more complete set of 
applicable standards. 



1A 
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#rariuuru>”'Du:»tsu 

Curriculum 

Skill Standards and Instructional Desigmi 

For the piirposc\s of thus monograph, curriculum is definuJ as instructional 
materials developed for student use in the classrcKMii, laboratoi^, or shop. It is 
assumed that the curriculum will be designed to address a specific set of vali- 
dated skill standards that meet the criteria adopted by the curriculum devclc^per. 

The basic element of a standards-based curriculum is a set of skill standards 
validated by incumbent workers in the indusny or occupation(s) addressed. To 
be usable for curriculum development, the skill standards must be specific and 
have performance indicators. 

Standards'based curriculum development is an instructional design process that 
uses a systematic content identification and deliver^' procedure. The priman/ 
elements include business-industry-labor validated skill standards that identib' 
standards of competent performance and an associated assessment system. The 
primary difference between standards-based and nonstandards -based curriculum 
development is the use of an industry-determined standard, as opposed to cnie 
derived by educators. 

The standards movement has not had a significant impact on the curriculum 
development process, despite efforts of various standards developers. Numerous 
states and multistatc consortia have developed curriculum using a standards- or 
task-based process for more than 25 years. Although in the 1960s and 1970s 
many states had functioning curriculum development centers, today the number 
of states that develop student-use curriculum materials is ver^’ limited. At the 
state level, Missouri, Ohio, and Oklahoma still provide financial support for 
student-use curriculum development. Other states, especially small states witli 
less federal funding, have gotten out of the curriculum development business. 

The most well-known example of a long-term, multi-state curriculum develop- 
ment consortium is the Multistate Academic and Vocational Curriculum Con- 
sortium (MAVCC), which began in 1973. This consortium of states joined 
together to develop student-use materials fur programs with limited enrollment 
in the members’ states. Texlay, however, MAVCC <http://www.mavcc.org> 
curriculum addresses many areas commonly found in the vocational deliver^' 
system in states across the nation. 

With the change in graduation requirements fostered by the publication of A 
Nation at Risk (National Commission on Excellence in Education 1983), classic 
vocaticMial programs designed for occupation-specific preparation have disap- 
peared from many states. The emphasis on increased academic content has led 
to two ver^' significant changes in the ccMitcnt of vocational programs. The first 
change is the increased emphasis on the integration of academic and vocational 

1 « 
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education content, and the second change is the move to broader skill prepara^ 
tion. These broad areas are known as career pathways, career clusters, career 
academics, or by .^ome title connoting prepara riem iot a career, as opposed to 
preparation for a specific occupation. 

Curriculum development for career clusters or pathways is somewhat more com- 
plex, given that the cluster is defined by the educational philosophy of the devel- 
oper. Therefore, in most instances the content of the curriculum will depeiid on 
developmental decisions, as opposed to tKcupational requirements. Given this 
variance, nonoccupationally specific curricula will draw skills from multiple 
standards sets. 



A potential solution to the career cluster development dilemma, however, is the 
KSSB objective of establishing skill standards for the “Core’' and “Concentration" 
areas of an industry (for a full discussion of this topic see the NSSB website at 
http://w'ww.nssb.org/). In theory', the Core Standards would apply across an indus- 
try', whereas the Concentration Standards would relate to a subset of several 
related occupations within the industry'. The proposed Concentratiem Standards 
w'oiild have the closest I'elationship to a career cluster for curriculum development 
purposes. 

One example of “Core" standards was developed by the Linking Academic and 
Occupational Skill Standards project (1998), and is available on their website 
<http:/7ww'w.mfglinks.org/Rpt34_co.htm>. Generally speaking, ir falls to the 
curriculum developer to select the specific skill standards to he included in a 
pre vocational or clustered vocatioiral program. 

A potential benefit of standards-based curricula is the facilitation of tech-prep 
articulation agreements. Much has been written about tcch-prep and articulation 
agreements. Suffice it to say, a standards-based curriculum tadlitates tech-prep 
delivery, given the shared responsibility^ in delivering the curriculum. Skill stan- 
dards sets provide a primary communication too! for tcch-prep articulatica'i, if the 
standards set has the necessary' level of specificity. 

Qudity skill standards materials provide a base for program planning; compre- 
hensive, valid, job-specific data for developing standards based curricula; informa- 
tion that as.sists in the identification of required program prerequisites; standards 
of acceptable skill performance; a basis for developing assessment systems; a tool 
for horizontal and vertical articulation; and a base (sp)ecific skills/tasks) for dia^ 
logue with industry to expedite the development of short-term training materials 
for new' or expanding business/industry'. 

There are a number of models or systems for implementing standards-based 
curricula, and most systems include the following elements; 




Conduct needs analysis 

Obtain a set of national, state, or business-industry skill standards 
Est'ablish program advisory committee 

Review skill standards set to identify vocational-technical program content 

19 



• Develop assessment process and instrumentation 

• Dcvclop/adapt/adopt instructional materials 

"" Review and revise curriculum on an ongoing basis 

Conduct Needs Ancilysis 

The first step in the dcvelopnient process is to conduct a needs analysis. This 
activity' will indicate a demand (or lack of demand) for employees in the industry’ 
or occupation (s) that the skill standards represent. The needs analysis can be 
formal or informal; it involves the identification of employers in the area and the 
use of scnnc n'pc oi survey (phone or mail) to determine the status of employment 
needs. Labor market data, gathered at the local or state level, provides projections 
of future employment along with training and wage data. At this stage of the 
development process, tech-prep program deliveiy' shcmld be a consideration. 

Obtain Set of National or State Sbili Standards 

As indicated earlier, many state and national sources exist for skill standards. This 
situation is dynamic, and the advent of the Internet and availability’ of web-based 
resources makes the search process mueh easier and quicker, A search of the 
ERIC database using appropriate descriptors is a suggested initial activity (see the 
ExccutK'e Summary', p. vii, for suggested descriptors). State and national and 
business-industry' skill standards listings and links can be found on such websites 
as the National Skill Standards Board <http://www.nssb.org/>, or the Virtual 
Scenario Tools’’'^' <http://www.skillsnet.org/vtecs/indcx.hrm>, A search at 
SkillsNet’''' <http://\vw\v,skillsnet.org/ html/skillobjects.html>, will yield Skill 
Objects'^', with standards sets designed to respond to skill training needs. Most 
websites have helpful links to other sites. 

Establish Program Advisory Committee 

The basic elcnient in the curriculum development process is a business-industry' 
advisory committee. An ongoing program is likely to have an existing advisory' 
con^mittee. If the pi'c')gram is new, then the administration and instructor must 
establish a program advisory^ committee that includes workers, labor, supervisors, 
and employers from the (Kcupation or industry' cluster under development. 

The primary' goal ot the initial committee ntceting is to identify' the skill standards 
that local employers believe the curriculum must include. It is unlikely that most 
programs W'ill be able to cover all the standards in a skill standards set, S(') selectiv- 
ity' is a requirement. One methcKi is to identify skills that incoming or “entty'- 
lever employees should be ccmipctent in performing. This group ot skill standards 
must be in the curriculum, since skill training and practice on performing these 
skill standards will differentiate between the perftumai'icc and productivity of a 
new employee hired “off the street” and one frcmi a formal vocational-technical 
education program. 
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The Hv .t lypc of skills are those hesr learned on the job (work-hased insrriicdon), 
as epposed to schooMrased instruction. These are the skills that require special' 
i:ed equipment, stare''nf'the'art equipment not available in tlu‘ program, or skills 
that for other reasons are hesr acquired in the work einaronment. 

The third level of skill standards \v<uild he the nu>st ctanplex skill standards 
performed by the experienced practitioner ones that most generally would bo 
learned throujth extensive on'theqoh experience or training pre^^trams offered 
directly by the business or industry. 

Reuiew Sbili Standards Set to Identify 
Vocational-Technical Program Content 

The theoiy or knowledge base for skill standard perfc^rmance must be identiiied, 
since this will provide the link between skill standards in the occupation and 
transferabiliry of knowledge to other occupatiems. Much of the theory’ and knowl- 
edge base in an occupation is usable throughout that occupation and in many 
cases, throughcHit the associated industiy 

The majoriy of national and state skill standards are developed in such a manner 
that specificity relative to skills and knowledge is either not included, or is so 
broad as to he of little value. If the curriculum is to he shared state or system wide, 
then the academic and technical skills that hack up performance must he clearly 
defined. One tool that has been used for academic analysis by multiple states is 
the SnyderA^'-TECS Academic Skill Taxonomy (Arizona State University 199Q), 
referred to in rhe remainder of this monograph as the TaxcMiomy. This taxonomy 
is used tt^ identify’ the specific academic skills required for skill standard perfor- 
mance, and ir can he linked to multiple states' academic ccontent standards to 
demonstrate academic content. Fcor a full discussion and identification of the 
associated analysis process see Linking Academic and Occupational Skill Stan- 
dards (Losh 1998), Such states as Virginia, South Carolina, Mar^Tmd, Illinois, 
Arizona, Michigan, and Maine use this process to provide the ability to share 
standards based curricula. Numerous stares including Ohivo, Oklahcoina, and 
Missouri have systematic processes to align their state content standards with 
their vocational curricula. 

Develop Assessment Processes and Instrumentation 

One thing to keep in mind relative to assessment is the birsiness axiom that 
“What gets measured is what matters.” For this reason asscssment/testii'ig drives 
curriculum content and, as indicated earlier, the presence of performance criteria 
or measures (the standard) for each skill is a critical step in selecting a standards 
set for use in curriculum development. If no performance criteria exist, then the 
development of valid assessments and related curricula becomes very difficult, 
requiring the identification of performance criteria prit)r to establishing an assess- 
ment process. Given that this is equivalent to revalidating the skills and identib’- 
ing the standards, the need for standards with skills is reaffirmed. 
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Once I'hc skill standards to be included in the pro^Tam have been identified, the 
next step is to review (or develop) instruments to determine student master^' of 
the selected skills, To determine competent skill standard performance, there are 
many assessment processes that can be used. As indicated in " V‘ Status oi Alter- 
native Assessments through the 1990s (Border 1998), niimc us authors suggest 
that in addition to performance testing, criterion-referenced tests (both written 
and cognitive) be used to determine and document student skill performance. 
(For further information on the topic of criterion-referenced assessment, an ERIC 
search is suggested.) 
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In some cases, skill standards can be clustered so that multiple skill standards can 
be assessed at the same time. A caveat, however, is that the more skills to be 
assessed in a single clustered assessment, the more complex the assessment and 
related scoring. This was noted by Border (1998) in her review of the WestEd 
Career-Technical Assessment Program (C-TAP) in California. 



If the product of skill standard performance cannot be readily measured, then the 
performance process elements or steps must be checked to insure competent 
performance. The assessment must identify conditions, constraints, and instruc- 
tions to the student, and it must describe competent performance. The a 'sess- 
ments must also include instructions to the evaluator. The development of valid 
and reliable assessment processes and instrumentation is a complex issue, beyond 
the scope of this monograph. Given the accountahiliry' requirements of the 1998 
Carl D. Perkins federal vocational legislation, many states and localities are 
grappling with this challenge at this time. 

Once the assessment process and instruments have been identified, the next step 
is the development of the content delivery system the student use curriculum 
materials. 



Develop/ Adapt/Adopt Instructional Materials 






The first step in the curriculum development process is to conduct a search for 
curriculum that has been developed for the occupation or industry' that relates to 
the standards set o( interest. Extensive resources have been committed to curricu- 
lum development over the past 25 years, and there is a large ann)unt of curricu- 
lum material available in vocational-technical education. Although the number 
has decreased significantly in the last 10 years, some states still have a curriculum 
development center or individual at the state level respcmsiblc for curriculum. 
Therefore, in addition to searching ERIC and the Internet search, the state 
department of vocational-technical education must always be contacted to 
determine what exists in the state, or how state-level contacts might be of assis- 
tance in locating existing curriculum materials. A phc)iic number for the office of 
each state dircctc^r of vocational-technical education is included in Appendix B. 
To verify these numbers, go to the National Associatic^n of State Directors of 
Vocational Technical Education Ctmsortium website <http://www.iris.org/ 
'-nasdvtec/ main.html >. 
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Given chat the amcxint of curriculum development conducted is directly related 
to cost and time, existing resources niust always he reviewed to determine what 
might be usable. In curriculum development, there are three basic levels of cost/ 
time commitments. First, “develop” is most costly in time and dollars; “adapt” is a 
happy medium in time and cost; and finally, the best alternative, if possible, is 
“adopt.” By identifying existing material and adopting or making minor adapta- 
tions, the new or updated staiidards-hascd curriculum can be online and students 
can be pn^ductivc in a very short time frame. 

If curricula do not exist in the format or content desired for the program, then 
developing or obtaining student-use instructional material is the next step. In 
standards-based curriculum development, the use of instructional/assessment 
scenarios is an emerging trend. Scenario-based instruction is an extension of 
earlier contextual learning approaches that include project-based learning and 
“instructional modules.” Small learning segments are prepared for student use, 
providing “chunks” of meaningful learning that can be quickly modified. With 
rapidly changing tcchn.ologv’ and the mo^'e to career pathways or clusters at the 
secondary' level, this tv^pc of curriculum, development and instructional delivery 
has many advantages, with flexibility^ as the major benefit. Scenaric^s provide a 
contexr for the dclivei7 of skill standards content, and they also lend themselves 
to the use of the Web to deliver and modify the scenarios (see http:// 
www.skillsnet.org/vtecs/index.htm). 

Given the trend in many states toward the use of scenarios as a replacement for 
traditional curriculum, this monograph emphasizes scenario development rather 
than classic curriculum de\'clopnient systems documented in ERIC and numerous 
textbooks. The next chapter provides detail and tc’)ols for the development of 
instructional/assessment scenarios. 

Review and Revise Curriculum on an Ongoing Basis 

The rate of technological change and its potential impact on vocational-technical 
curriculum are phenomenal. It is also true that regardless of the quality' of a 
pr(’>gram, continual review impnwes the experiences gained by students participat- 
ing in the program. The program advisory committee is a major factor in program 
review. The feedback they provide, when coupled with instructor observation of 
student performance, w'ill be a key to what and how much revision is required. 

The curriculum must he reviewed annually to identify^ standards changes that are 
occurring in the industry or occupation and to make the appropriate changes to 
the program. Instructor review of student performance relative to pmagram skill 
standards triggers the need for conrent revision. Continuous review and recycling 
is a major acti\'ity in siandards-hased curriculum development. If review is dili- 
gcntl) ct'Jiuiucred, the standards-based program will provide learning experiences 
that will meet the students’ needs immediately and in the future. 
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Dmfehping 

Rating Student Performance Standards- 

Based 

In most education systems, assessment and rating of student performance coniiiv Curriculum 

lies to he a fact of life. Renewal of tl'ie curriculum, based on standards, will nor 
change this instructor responsibility. Additionally, where some type of skill certifi- 
cation is in place, certificate reviewers need to sec the criteria used in awarding 
the certificate. An example of a simple siandards-hased raring system (many 
systems are similar) uses the following scoring rubric: 



0 — No Exposure. Observes only. 

1 = Attempt only. Unable to meet performance standard criteria and/or requires 
significant assistance. 

2 = Partially Demonstrated. Meets some of the performance standard criteria 
with or wirhoui assistance. 

3 = Performance Demonscrated. Meets performance standard criteria wirhotit 
assistance at least once. 

4 = Mastered. Successfully applied performance standard to solve related prob- 
lem independently. Works independently without constant supervision. 

Given that these rating numbers indicate *'emplc^yahilit^' readiness,'’ they are not 
designed as grades. This performance rating system is included in the V- I HCS 
CONNECT program software designed to assist in the management and report- 
ing of work-based learning programs. 

For those vskill standards in which the student did not demonstrate a level 2, 5, or 
4 performance, no indication of performance would be included on the final 
report. In addition, a grading procedure might include identifying the percentage 
of time required to perform the skill standard competently compared to the 
average time required; identifying the number or percentage of total skill stan- 
dards the student mastered compared to the enti 7 or program-level requirements; 
or factoring attendance, work habits, and other work-related components into the 
final grade, In some instances a percentage may be adequate, although a percent- 
age immediately raises the {.juestiem of which or what part of the standards were 
not adequately performed. 

If at all possible, a listing of skill standardvS competently performed at the time the 
student leaves the program prmides the best information for empk^ers and 
students. A search of databases such as ERIC can identify grading and perfor- 
mance rating systems that might have utility in a specific circumstance. 
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Contextual Instruction and 
Scenario Curricula 

Contextual Instruction 

Numerous autliors, includin|j[ Bailey (1998), Bottoms and HSd'W Staff (1997), 
Raia'n (1989), Smith et al. (1998), and Siasz ct al. (1993), report that contex- 
tual instruction pro\'ides si^mificant impro\'emcnts in learning and retention of 
insimction among learners of all age gnnips. Contextual instruclion prosades for 
rile impro\'ement of hoih academic and vocational-technical instruction, k)r 
these rcas(Mis: 

Vocational-technical instructors can ensure that the required aca- 
demic content is included or embedded in their instruction. This 
provides opportunities for academic skill reinforcement for students 
enrolled in the occupational prcparaticni program and gives assurances 
to employers that the required academic content is covered in the 
program. Academic instructors have a dcmonstrahle context for 
academic instruction, prtivided hy instruction that lias more utility to 
the learner and is more robust as a learning tool for the majorit^^ of 
students. The role of vocational-technical education in helping 
students learn, retain, and achieve the state’s academic content 
Standards is further defined. 

Skill standards pro\’idc a natural content base for contextual instruclion, gi\’cn 
the skill standards’ relationship to business and industry, and therefore, the real 
world that most students will ultimately enter. Simply stated, contextual instruc- 
tion provides oppeatunity to develop materials that involve the world of work, 
ntU‘ a synthetic or academic context, hut one that is ideally related to business 
and indiistn' skill standards. Standards-based sccnari(')s are not abstract applica- 
tions, hut rather, applications that learners (regardless of age) can identify* as 
real. 

The National Alliance of Business (1999) states: 

Increasingly, the business community is working actively with educa- 
tors and trainers to articulate changing market needs and skill stan- 
dards and CO demonstrate flexible, rapid-response solutions to prepar- 
ing pcc'jple for tomorrcWv'’s business environment. This communicatk'>n 
takes many forms, from supporting higher academic standards and 
contextual learning to asking recent graduates for school transcripts. 

This empl(')ycr in\*olvemcnt signals that the business community* \aews 
academic and real-world learning as critical factors in students’ suc- 
cess. (p. 4) 




Acconlin^^ in Klein cl al, (1997): 



(^'asc smdy visiis siif^^'csi ihat few ediiciilors have the technical back- 
jjrouncl to deploy tl inclusti^-spccific skills iii the classroom. Specifi- 
cally, academic teac. ts alien leach their subject area disciplines 
without refcreiK e to the workplace, in part because textbooks and 
other instructional resources often i^^more the relationship between 
schoolini^ and work. (p. 7) 

The quickly chanjj[in^ clmUciu of work requires a mcKlular approach to curricii- 
liim. Scenario-based instruction provides a rich context for the iiite|L:;ration of 
academic and vocational education. An additional benefit Is the ability to update 
quickly or supplement cxistin^y materials with new scenarios as skill standards 
reflect changes in work. Scenarios also lend themselves to Internet delivery and 
j'irnvide instructional tools that can be used by lar^e numbers ol instructors, borh 
academic and vocational. 

Scenario-Based Instruction 

Changes in fundini^ practices at the federal lc\'cl have had a significant effect on 
the development and delivery of vocational curriculum materials over the past 20 
years. Differing philosophies have resulted in changed funding models froci grants 
to states for the support of large curriculum research and development efforts lo 
significantly increasing the funding that goes to the local level. In the majority of 
instances, local vocational education deliverers arc responsible for obtaining or 
developing the curriculum that is used in ibeir vocational programs. As a result, 
in most states, student-use curriculum materials arc primarily privately published 
textbooks, with limited supporting material developed by the local instrucUa*. 

As a reflection of funding changes, quickly changing technology', and the impact 
of clustering at the sccondaiT level, there is an increasing emphasis on the devel- 
opment of instructional materials that are modular and media based and can he 
quickly modified to i- '^ect changes in content of the delivery system. The rate of 
change, cennbined with the increasing use of the Internet in both the develop- 
ment and delivery of instructional materials, has increased the use of instruc- 
tional/assessmcnt scenarios as a vehicle for meeting the needs of large groups of 
dix'crsc learners. Scenarios, one type of contextual learning, provide vehicles for 
including content from various disciplines in the same instructional experience, 
thereby enriching the learning experience and providing the demonstrated ben- 
efits of contextual instruction. Case studies are another type of contextual learn- 
ing. The primai 7 element of a case study (the case) has similarities to the work- 
place context of a scenario. In most instances, however, specific academic and 
workplace skills, and scoring rubrics or criteria arc generally not included in a case 
study. 

With increasing academic credit requirements for high school graduatiem, in 
many states there has been a decrease in the amount of time allocated to voca- 
tional education at the high school level. This reduction in vocational education 




has been targeted at preparation for specific occupations, and is resulting in 
greater emphasis on broader skill set preparation. At this time, various clustering 
techniques are being used by states, including Career Clusters, Career Pathways, 
Career Academics, or other skill clustering schemes. Scenario 'based instruction 
can be used in all vocational program structures, including cluster-based and 
more traditional occupationally specific programs. 

Scenarios offer the opportunity^ for students to use a combination of 
technical skills, workplace skills, related academic skills, problem- 
solving, creativity^, and other higher-order thinking skills to solve the 
problem posed in the scenario assessment. The problems posed are 
from real-world situations in business and industry\ communities, and 
other settings. (Border 1998, p. 36) 

Beuder identifies several t^'pes of scenarios that have been produced for instruc- 
tion and a.ssessment, including the V-TECS prototype in Appendix C. 
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Numerous entities have conducted extensive development and implementation 
work in the use of scenario -based instruction as a tool for instruction and aSsSess- 
ment, and in many instances, integrating vocational and academic content. 
Included in these groups is WestEd in California, where Dr. Sri Ananda has led 
extensive scenario development activities <http://www.wested.org/>. Dr. Joyce 
Malyn-Smith at the Center for Education, Employment and Comnuiniry' at the 
Education Development Center Inc. <http://ww'W’.edc.org/> has published 
numerous papers and led workshops on the development and implementation of 
scenario based instruction. Dr. Chris Olson <http://www.mfglinks.org> devel- 
oped and implemented a scenario-bavsed assessment system for student and 
worker skill certification in the state of Indiana. Indiana developers use a software 
system called “PROFS” to develop their scenarios in conjunction with business 
and industry*, which providCvS a high level of content validity to Indiana assess- 
ment scenarios. 



One of the new tools being used io enhance ci^ntcxtual instruction and scenario 
development is The Linkage System (Losh 1998), developed to provide re- 
sc')urces for contextual instruction and scenario development. The system is 
designed to link academic content standards and occupational-vocational skill 
standards, and it provides support of the Internet-based Virtual Sccnaru') Tools 
The standards linkage process is as Fallows: 



• Analyse the state -adopted academic c(')ntent standards to identify the appli- 
cable Toxono77iv skills and establish a state content standards database “cross 
walk.” 

• Analyse occupations, vocational pn')gram content, or skill standards to identify 
the Taxoi.omy academic skills required for comperenr performance. These are 
called the “rclated/rcquircd academic skills” (RAS). 

• Analyze occupations or vocational program skill standards to identify the 
Taxonomy academic skills required for cmnpetent performance, and then 
crosswalk tlie occupational RAvS to state academic content standards. 
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• Load analysis results in web-bascd software system for instructor/developer 
use. Use the Virtual Scenario TckiIs’'^^ to adopt/adapt/develop scenarios for 
instruction and assessment. 

• Develop weh-'based Virtual Scenarios for instruction and assessment. Access 
the Virtual Scenario Tcuds*'^’ website <hnp:/Avww.skiIlsnet.orgA'tecs/ 
index.htm > for Linkage and Virtual systems. 

The Linkage System' (Losh 1998) links academic content tc^ skill standards for 
curriculum development. The Virtual Scenario Tools'^k an Internet'bascd see- 
nario development, banking, and retrieval system, will provide the following 
capabilities and resulting benefits to users: 

• Provide for Internet (onlir\e or offline) based development c^t instructitMial ' 
assessment scenarios with a business and industry' skill standards context. 
These scenarios also include academic and workplace/SCANS (Secretar^’'s 
Commission on Achieving Necessary' Skills) skills. 

• Provide a systematic process for “banking ’ (storage and retrieval) of insrruc' 
tional/assessn'ienc scenarios on the Internet or CD-ROMs. Users can search 
the site using academic or technical skill terms to identify existing scenarios to 
adapt or adopt. 

• Provide Internet-based toeds lo link a stare’s academic content standards, skill 
standards, and scenarios that support student performance in an integrated 
manner. 

• Provide a powerful set of Internet-based nK)ls for the integration of vcKational- 
technical and acadenue instruction. 

• Provide evidence of \'ocational/tcchnical/tech-prep course academic skill 
attainment suppcMt. 

• Prt .ide support for all learners’ academic and technical skill attainment. 

Additional materials are provided in Appendix C for user-conducted scenario 
development wt^rkshops. 

Scenarios: A Tool for Integrating Academic and 
Vocational Education 

In vocational-technical education, federal legislation has called k^r increasing the 
integration t^f academic and vocatkmal education. This lias pren'ed U) be a signifi- 
cant challenge ior instrucUM's, both vocational and academic. The challenge has 
been the identification and linking of both technical and academic standards in a 
context that is useful to instructors. Scenarios, given their modular format and 
the facilitation of joint local development, provide for the integration of Knh 
academic and viKational content, using a rich environment for acquisition of 
workplace, academic, and technical skills. Much work has been accomplished in 
moving scenario deeelopmcnt forward, and the previously identified developers 
have influenced the model and developmental system and tools described in this 
moncMgraph. 
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Including skill standards and state academic content standards in a scenario 
context provides two significant benefits. First, the use of industry-based skill 
standards provides a state-ofithe-art context for vocationaUtechnical program 
content. Second, scenarios provide an ideal setting for identifying, delivering, or 
reinforcing state academic content standards, for which all students will be 
required to demonstrate proficiency. Scenarios can he customized to include the 
states’ academic content standards or specific academic skill sratemenrs such as 
those identified in the Taxonomy. 

Academic instructors also find useful these scenarios developed around national 
or state skill standards. The real context gives them the ability to answer the 
perennial question, “Why do I need to learn this (academic skill)?” as students 
struggle with an abstract or nonexistent context for academic skill content. 
Scenarios that include the technical, academic, and workplace skills needed for 
success on the job, cither immediately or after a post-high school experience, can 
provide a valuable tool for integrating and improving instruction for all students. 

Scenario DeveBopment 



CSSmSSSSMB 

Contextual^ 

Instruction^ 



Scenarios can be developed for instructional or assessment purposes. The scenario 
model presented in this monograph has utility' for both purposes, but is essentially 
an instructional or curricular tool. As an instructional tool, the primary develop- 
ers are instructors. The products of their work are materials that can be used in 
their classrooms, shared with other instructors, and modified to meet the needs ot 
other vocational programs. 



Althcnigh scenarios, as well as all curricular and instructional materials, can be 
developed by individuals or groups, this monograph provides tools designed for 
professional development workshops offered one or more times e\'ery year in all 
schools. Professional development or inservice programs are the traditional 
method of getting new materials and concepts to instructors, and scenario devel- 
opment, as an inservice activity, yields usable materials in as little as a 2-day 
workshop. Obviously, longer sessions yield more materials, and continuous fo- 
cused professional development over the school ycar(s) has the most lasting 
impact on the u'ay instruction is actually delivered in the classroom, shop, or lab. 



Ideally, the scenario development ream consists of busincss/industr\' advisor^' 
committee members to provide real cc:)ntext for the scenario, and academic and 
vocational tcachens to provide a cross-fertilization of content. This mix gives both 
of the disciplines greater awareness of what the other can prewide and how the 
content areas interrelatv to improve student instruction. Scenario development 
can provide a venue (one of the few) that actually facilitates the integration of 
academic and vocational education, as required by federal legislation. One of the 
major problems in developing student-use curriculum is the need to adjust the 
materials to the instructional environment. A scenario that is dev* loped or 
modified by the instructor who uses it compensates for the quirks of each instruc- 
tional venue. Additionally, scenari(\s can be endlessly modified to meet the needs 
of special education students. The content included, and the complexip', can be 
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modified for delivery to all students. Scenario development workshops can address 
the real world of schools, which includes instructors from junior high industrial 
arts, traditional high school home economics programs (now family and con- 
sumer sciences), and occupationally specific trade and industry^ programs. By 
discipline grouping, instructors are able to develop scenarios around skill stan- 
dards and occupational task lists, or identify tasks appropriate to home makers or 
junior high students. Use of the scenario models provided in Appendix C and the 
scenario review criteria found in Appendix D provides instructors with the capa- 
bility of scenario development from industry^-based and validated skill standards as 
well as tasks and standards that are “home grown.” 

Developing scenario curricula requires a systematic approach, as does all curricu- 
lum development. The system identified by this author includes the following 
steps: 

Obtain relevant task listing/skill standards set 
Convene a review committee from local business/industry’ 

Identify’ the tasks/skills to be included in the program 

Develop instructional/assessment scenarios, including academic and workplace 

skills required to perform the scenario 

Establish an assessment process 

Develop a skill certificate 

Grant certificates of demonstrated performance 

Note: Materials associated with delivering a scenario development workshop 
(except the skill, academic, and w'orkplace standards) are included in the Appen- 
dices for use in inscr\icc sessions. 

Although skill certification is not necessarily a part of or requirement for the 
development of a scenario-based instructional system, certificates that identifr the 
skills mastered by students provide a valuable addition to their portfolios or other 
record sets. This ty'pe of documentation is becoming more prevalent, indicating to 
orhers (and to the student) specific skills the student has successfully performed. 
An example of the value of this type of certification is in the state of Indiana, 
where Skill Certificates signed by the Governor, granted after a scenario-based 
assessment, ha\'e value in entering higher education institutions in Indiana. For 
further information on this certification process, contact the Indiana State Direc- 
trir of Vocational-Technical Education (Appendix B). 

Skill Standards Scenario Planner 

This “Sccjuind Planner" is suggested for the development of scenario based cur- 
ricula and in^tmclional materials fc'>r the 21st century'. This model includes the 
elements required for a high-quality’ instructional system when coupled with an 
instructor’s existing classroom/lab management techniques. A primary hands-on 
tool for the scenario developer, be it an individual ('>r a team, is a device to cue the 
developer as to the desired content of the scenario. For this system, the Skill 
Standards Scenario Planner includes the following topical areas to be addressed 
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by the developer. An example of a completed Scenario Planner is included in 
Appendix E, and a blank planner is in Appendix F to be copied for scenario 
development workshops. 



Contextual^ 

Instruction^ 



Skill Standards Scenario Planner 



Scenario Title 
Date 



The title of the scenario should be shorty but convey the content of the scenario 
so that the reviewer can determine, be it broadly, the general area of concentra- 
tion. Titles might include Develop and Conduct a Safety Review Program, Iden- 
tify' the Cause of an Automotive Braking Problem, Design an Irrigation System for 
an Oriental Garden, or an infinite number of other possibilities depending on the 
area of emphasis. 



The Scenario 
Title and the 
Development 
Date 



The skill standard (s) addressed in this scenario is identified here tor learner use. 
This is the crucial first step in the development of the scenario, as it will deter- 
mine the complexity and time required to perform the scenario. The general rule 
is to include only those skill standards or tasks that would normally be performed 
as part of a larger activity. The skill standard content will also be driven by the 
structure of the skill standards used, given the variance in skill standards sets 
discussed earlier in this paper. The inclusion of a large amount of content in the 
scenario is to be avoided, given that the larger the content, the more difficult to 
accurately assess performance and to indicate the quality' of performance of all the 
skill standards. A rule of thumb, once again, would be to review the standards set 
and include only those standards that would normally be included in the develop- 
ment of a product or completion of a process. A primary' source is the Naticmal 
Skill Standards Board <http://wwvv.nssh.org/>. An additional source is the 
Virtual Scenario Tools'^' website <http://www.skillsnet.org/vtecs/indcx.htm>, 
which is designed as a search resource fen* business and indiistiy, state, and na- 



Skill Standards/ 
Tasks Included 
in the Scenario 
(List) 



tional standards. 




This area of the Scenario Planner provides the wcuk-baseJ cenitext for the stan- 
dard addressed. In this section, the student is presented an actual problem \o he 
solved, and the wc'^rk-based context of the prcT-lcm is included for the student’s 
information. 



Workplace 

Context/ 

Situation 



Generally, this section will start with a statemen such as “You work at (scenario 
developer provides the context) as an cntiy-lcvel worker. Your job title is 
nario developer provides a .specific example such as [jnb\ assistant, Ijoh] 
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I Con textual 
^instruction 



lice, etc.)-” The context of the scenario will be directly related to the skill stan- 
dards identified earlier in the scenario. The next portion of the situation prenades 
the actual challenge or problem that exists in the workplace that the student (or 
team of students) needs to solve. This must he an actual event that a beginning 
worker might be asked to analyze and solve, cither individually or as a team 
member. The prc'^blem, when coupled with the actual workplace environment 
provides the contextual instruction power of the scenario. This section of the 
scenario will provide for inclusion of ‘All Aspects of the Industn*,” another Perkins 
requirement. Finally, the time required to complete the scenario must be identi' 
fied, so both the performer and the ev^aliuitor will have guidance as to perfor- 
mance expectations. 



Academic Skills 
Required 
(Math, Lan- 
guage Arts, 
Science) 



In this section, the academic skills required to perform the scenario are identified 
Ideally, academic instructors would he part of the development ream and would 
play a major role in the development dialog identifying the skills. They would use 
the developed scenarios in their instructional program for contextual instruction. 
These skills need to he specific. It is not adequate simply to state that reading or 
math is required. The type of reading and the specific math and science skills 
required must be identified. If other academic skills such as social studies, art, or 
foreign language are required or reinforced by the scenario, they also need to be 
identified. The two basic tools for this identification will be cither the Taxonomy, 
or the state academic content standards skills that are reinforced or required for 
scenario performance. Many state academic content standards arc so broadly 
stated, hewever, that the developers will need to be more specific and turn to a 
recognized resource that provides the required specificity. The academic skills 
must he clearly documented to support the academic vcxatUMial i)itegration 
documentation requirements. 



Workplace 
Skills (Team- 
work, etc.) 



This section will include the workplace skills such as teamwork, communicating 
with customers or associates, and other skills found in numertuis workplace skills 
dcKiunents such as SCANS (1991), the Workplace Skills (Southern Association 
of Colleges and Schools 1998) developed hy the State of II linens, and other cenn- 
mcrcial and public materials. It is critical chat these types ol skills he included, 
because employers often cite rhe lack of such skills as a rcastni f('>r employee 



termination. 



Scenario Set-up 
Directions for 
the Instructor 




This secciem includes directions [o the instructor on setting up the scenariu 
conditions or “givens.'' Set-up includes technical publications, equipment, safety, 
and other matcrials/ctn'idititms that are required for the student to perform the 
scenario. This must he clear another instructor in the same area and to a 
student attempting to perfium the scenario. Setting up the environment for a 
scenario is a crucial component ot providing the context for the student to per- 
(orm the scenario. If product or process specifications manuals, tools or ecjuip- 
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Contextual 

merit, or other “givens” are required for competent scenario performance, they Instruction 

must be identified. Since one advantage of scenarkvhased instruction is transport- 
ability, other instructors who use the scenario must be able to replicate the perform 
mance environment. 



This section of the planner identifies the criteria for successful scenario perfor- Performance 

mance. This section tells the learner the criteria that will be used to assess the Criteria/Assess- 

demonstrated performance. The national or state skill standards identified for ment Rubric/ 

inclusion in a scenario shcmld have indicators of acceptable performance incorpo- Checklist 
rated as part of the standard. The scenario developer can use these as the basis, or 
in some instances, they are inserted directly into this section of the scenario. In 
the event that the skills identified for the scenario do not have predetermined 
standards, the developer must identif^^ what constitutes acceptable performance. 

Providing detailed criteria for determining scenario performance is critical. One of 
the major challenges of instruction and assessment of this type is reliability of the 
performance ratings between instructors or evaluators. The specific subsets of the 
overall performance that are critical or dift'erentiate levels of performance must be 
identified. Where a certificate is granted that may affect an employer’s decision to 
employ the holder, it is critical that variance in evaluator ratings be minimized 
through the development of detailed rubrics that can be used to assess and mark 
performance, If the student is to be granted a skill certificate as a result of perfor- 
mance on a set of scenarios, Border (1998) suggests the inclusum of a written 
exam over the sanie material covered in the scenario or set of scenarios. Inclusion 
of a written exam increases the reliability of the scoring of the scenario. In all 
instances, the student must clearly understand what is included in the perfor- 
mance expectations and how he or she will be evaluated by the performance 
criteria. To help the scenario developer, examples of scenarios are included in 
Appendix C. 



The final area to he completed in the Scenario Planner is the identification of the Development 

development team members. This should include the job title of team memhers, Team 

since, as indicated earlier, involvement of busiiicss/indiistiT advisc^ry* committee 



members on rhe development team provides \’aluablc input. 



The Scenario Development and Review Rubric 

To help the developer or user of prede^’cloped scenarios, Instructional/Assessmcnt 
Scenario Criteria with accompanying ratings are included in Appendix D. This 
criteria sheet includes the follo\^'ing scenario topics or areas that the developers/ 
users need to consider as they initiate a scenario-hased instruction process. 
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I Contextual 
^Instruction 




The first area to review is the skill standard (s) included in the scenario. For 
scenarios that are related to vocational programs that provide work force skills, 
the identified standards should relate directly to the skill preparation in that 
program or industr^^ cluster Regardless of the specificity of the program, occupa- 
turn-specific or husiness/industry cluster of some type, the skill standards should 
be directly related and measurable. If no skill standards are identified, then the 
scenario will need to be analyzed to determine what skill standards the developer 
was attempting to address. For this area, the range is from *haot specified” to 
“definitive and measurable,” 

The second area of quality review is Iiow well the workplace ct)nt ext of the sce- 
nario is identified. This is a critical element since the performer must recognize 
this as an environment that reflects the real workplace rather than an academic 
exercise. The range of the review is from “the context does not reflect a realistic 
wc^rkplace” to “the context is realistic as stated in the scenario.” 

The third area deals with the problem provided to the student for his or her 
solution. The problem must not be trivial, since this is the area in which higher- 
order thinking skills must be required f(^r its solution. The richness and complex- 
ity’ of the problem will relate directly to the learning that can be ascribed to the 
scenario. The range for this area is from “the scenario problem is not clear or is 
trivial” to “a problem is clearly stated, of substance, and the learner has no ques- 
tions.” This area will require considerable effort, given that the level of problem 
posed to the learner will ultimately relate directly to the credibility of the scenario 
and instruction based on it. Connected to the context and problem is an identifi- 
catuMi of the time allocated to perform the scenario. The time to perform is a 
matter of developer judgment, based on the skills included in the scenario. 

Clearly, for those scenarios with numerous skills, more time will be required. 
Additional factors affecting time considerations are the amount of time available 
to perform, and the ty'pc of performance individual or team, 

A clear identification of the academic skills required to perform the scenario 
competently is the next area of review. In this instance, the academic skills that 
are listed may be reinforced through the scenario, or in the instance of an aca- 
demic instructor, the scenario may he the primary' instructional tool. The aca- 
demic skills stated in the scenario mu.st ultimately be linked to the state academic 
c(')ntcnt standards. The skills can either be stated as found in the Taxonomy, or as 
found in the state content standards. If they are vStated in the Taxon(Mny con- 
struct, they can then be translated to any user s academic content standards. The 
rating scale ranges from “no academic skills arc identified” to “the state academic 
content standards reinforced (in the scenario) are identified.” 

When individuals are not able to hold or advance in jobs, a prc^bablc reason is a 
deficiency in workplace skills. Workplace skills include iiiterpersonal relationship 
skills with associates, supervisors, and supervisees. It is clear that regardless of the 
discipline, working with other people is a major part of all jobs. Much research has 
been conducted, and many publications exist that provide documentation and 
identification of workplace skills. Among these publications arc the SCANS 
documents put out in the early 1990s by the Department of Labor (SC/VNS 1991 , 
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1992), the workplace skills and related assessment items developed hy the State of 
Illinois (Southern Association of Colleges and Schools 1998) and adopted hy V' 
TECS, and the Arizona workplace skills developed in the mid'90s. Numerous 
other states and private companies have published similar materials, and an ERIC 
or Internet search should show numerous sources for these skill statements. 

In addition, scenarios that emphasize workplace skills using skill standards can 
play a role in the overall vocational curriculum, providing increased reinforce- 
ment of these skills. The ratings for this area range from “no workplace skills are 
identified” to “includes skills and asscsvsinent rubric for the necessary skills.” 

The scenario must include Scenario Set-up Directions for the Instructor. For the 
student to be able to solve the problem presented, any tools, manuals, policy 
guidelines, charts or other resources required must be clearly identified. In some 
instances, this list will be short; in others, quite lengthy. As usual, this list depends 
on the skill standards addressed, the context of the problem, and the actual 
problem to be solved. The ratings for this area range from “no instructions are 
included” to “scenario set-up and performance evaluation instructions arc clear 
and unanibiguoLis.” 

Student evaluation using anything beyond classic written examinations is always a 
challenge. The identification of the criteria of proficient performance is critical for 
the reliability’ of performance ratings. For the skill standards covered in a scenario, 
the standards of proficient performance would he shown in this section. Users of 
skill standards and the developer of scenarios should always seek out skill stan- 
dards sets that include measurable standards and avoid skill standards sets that 
have broad skill statements with no or marginal standards performance criteria. 
The standards must be dear to the student, providing for clear communication of 
expectations. For this area, the range is from “no performance criteria is identi- 
fied,” to “performance criteria or assessment rubrics are listed and clear to 
learner.” 

Finally, the developer must ensure that the scenario isgemicr, culturully, emd 
nidally ncutrai Problems in any of these elements render the scenaric') unaccept- 
able and must he corrected prior to use. The range for this topic is from “includes 
references, terms, or words associated with gender, culture, or race” to “nc^ refer- 
ences, terms, or words associated with gender, culture, or race.” 




Conclusion 



The development of curriculum materials using valid and reliable skill standards 
has the pc^tential of improving the quality of both academic and vocationah 
technical educatic i. This will occur, however, only if vocationahtechnical 
educators carefully pursue high-quality' standards sets and implement them in 
their programs. Skill standards are produced by many entities, with business, 
industry, and labor being the primary provider of national and state skill stan- 
dards. Ultimately, the National Skill Standards Board (NSSB) and their volun- 
tary' partnerships will use criteria (under development at the time cT this mono- 
graph) to identity' skill standards sets that can be called “National Skill Stan- 
dards.” There are presently de fecto national skill standards in some areas, but 
none recognized by the NSSB. 

Skill standards provide the information needed to direct curriculum develop- 
ment efforts to the latest technok^gy' and techniques of business and industiy’. 
Both academic and vocational-technical curricula, using cither traditional 
processes and materials that have been developed for many years or more recent 
innovative delivery practices, can benefit from the adoption of a standards-based 
systen'i. 

The integratum of academic and vocational education has been mandated at the 
federal level since the early 1990s, and reinforced in both the school-to-work 
legislation of 1994 and the most recent iteration of the Carl D. Perkins legisla- 
tion. The use of scenario -based instructional materials that integrate skill stan- 
dards and academic ctmeent standards shows promise in providing t(x)ls that can 
help meet this goal. 

This monc’jgraph includes information and models for the user to develop and 
conduct continuing education workshops for the development of standards- 
based instructional scenarios. These field-tested tools provide a valid base for the 
knowledgeable workshop leader in the development of instructicMial scenarios at 
the local, state, regional, or national level. 
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Aa Excerpt from the V-TECS Heating, Air Conditioning, and Refrigeration 
Technician National Skill Standards Publication 

F022 Skill: Calibrate thermosuat and set heat anticipator. 

Standard: Thermostat must be calibrated according to nianufacuircr’s 
specifications. Calibrated thermostat must respond to space tempera- 
ture in which sensing clemeiu is located, heat anticipator must func- 
ii(.m to specifications, and thermostat must control air conditioning 
equipment to provide desired space temperature. Applicable safety’ 
procedures must he followed. 



An Excerpt fronn the State of Illinois Horticulture Standards 

Co to <http://\vww.standards. siii.edu/> for ccanplcle sets of numcrtnis stan 
dards. 

Identify, Record, and Process Damaged and Poor-Quality Merchandise 

SKILL STANDARD 
CONDITIONS OF PERFORMANCE 

Given company policies and procedures and the hdlowing equipment and 
malcrials; 

Plant merchandise (fresh flowers and foliage) 

Hardsctipc merchandise (\ascs, gilt items, plants, dried plant material) 
Rccoixls and forms 

Price marking etiiiipmeni and materials 



WORK TO BE PERFORMED 

Identify and record poor-quality, damaged, and incorrect plant inateiT 
als and hardscape merchandise; and process the mcrL'handise accord- 
ing to company policies and pr(cediires. 

PERFORMANCE CRITERIA 

PcH^r-qualily, incaurect c^r damaged plant materials and merciiandisc 
and merchandise within designated “sell by” Jate.^ are correctly 
identified and rec(^rdcJ; and materials and merchandise are correctly 
processed (e.g., pricing, disp(vsal) according to company policies and 
procedures 
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Aa Excerpt from the V-TECS Business Manaf^ement Occupations 
Skill Standards Publication 



Skill: Develop an annual strategic plan for an ongoing business. 

Standard; Ciiven a situation vvlicre you are considering expanding your business 
by adding a new product line or by opening a second location, develop a strategic 
plan for this expansion. The plan must include the following: 1. Evidence that 
data about the existing business, its competitors, government regulations, and the 
economy have been reviewed and considered in developing the plan. 2. Cloals 
and (d'ljectivcs with j:)crceived iMitcomes and target dates for the revised business. 
E Costs and reejuired resources. 4. Cost comparison of expansion versus opening 
a second location. 5. Identification of scxirccs of funding, considering forecasts of 
revenue from expansion. 



An Excerpt from the Concrete Worker Skill Standards 
Laborcrs-AGC Education and Training Fund 

Vertical Concrete Construction: Placement 

Conventional Industry Standards 

1. Lifts must be uniform within +V V (76 mm) over 20' (6.1rn) horizcmtal 
thrcMighout the “course.” 

2. C^oncrcte must be placed evenly to avoid excessive pressure in one form area. 

3. Concrete must be vibrated evenly until air bubbles cease appearing on the 
surface. 

4. Vibration must stc^^ before the mcM’tar and aggregate separate. 

5. Concrete must he consolidated approximately 18” (.46m) into the previous lift 
to ensure bonding and avoid cold joints. 

6. A^'oi(^ more than one, r’(25mm) honeycomb \\’ithin 48 st| ft (I4.63m2) 



An Excerpt from the Kentucky Manufacturing Skills Standards 

Level 2 Advanced 



II. Math and Measurement 



AA2 Academic 

AA2.1 Distinguish between direct and calculated measurements 

AA2.2 (Compute calculated measurements 

A02 Occupational 




A02.1 

A02.2 

A02.3 



Describe mcasurcmcats’ ndc in manufacturing 
Demonstrate pre^per precision measurement techniques 
Describe the appropriate application and use of precision measure-' 
ments in manufacturing 



To 



A02.4 Explain calibration requirements of various precision instruments 
A02.5 Illustrate measurement differences when taken with calibrated and 
noncalibrated instruments 

A02,6 Match appropriate measurement toeds with various types of measure 
ment requirements 

A02.7 Demonstrate proper measurement tool usage 
A02.8 State selection criteria for measurement tools 
A02.9 Interpret results of measurements and calculations 
AO2d0 List steps with rationale of proper measurement procedures 
A02.il Distinguish between general and precision measurement 
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The following three skill standards examples were extracted from the Occupa- 
tional Skill Standards Projects found at the NSSB website, http:// 
www^nssb.org/ 



Example 1. 

Author: Foundation for Industrial Modernization (FIM) 

Title: National Skill Standards Project for Advanced High Performance Manufac-' 

taring 

Source: Washington, DC: National Coalition for Advanced Manufacturing, 1995 

An example of a skill standard might he — 

Working alone with a calculator, add 10 two or three digit numbers five 
times in 3 minutes with 100% accuracy, in order to perform necessary^ 
calculations for Statistical Process Control (SPC) during the manufac^ 
turing process. To be documented by third party or performance assess^ 



Example 2* 

Author: Electronic Industries Association and Electronic Industries Foundation 
Title: Characteristics of Competency: Measurement Criteria for Entry^Tcv’cl 
Electronics Technician Skills 

Source; Washington, DC: The Foundation the Electronic Industries Associa- 
tion, October 1995 

II. Technical Skills 

The standards in this scctkni arc based upon the worker’s ability to know tl'ie 
technical basis for and be able to explain how a product, device, circuit, or procc 
dure works; to he able to apply that knowledge; and, as appropriate, to fabricate, 
demonstrate, troublcslioot, repair, or replace the product, device, nr circuit. 

Included in Technical Skills are — 



A. Ck'iieral SkHs 

B. DC Circuits 
(L AC^ Carcuits 

D. Discrete Sedid State Circuit'^ 
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E. Analog Circuits 
E Digital Circuits 

G. Microprocessors 

H, Microcomputers 

Many entry- level workers have difficulty troubleshooting a device to identify and 
locate a problem. They do not seem to understand what needs to he done, where 
to start, or how to proceed. Master^^ of troubleshooting techniques as specifically 
defined in the skill standards should be incorporated into training. 

Many students are being taught on obsolete equipment. They should have access 
to state-ohthe-art test equipment and should learn on the same technologies they 
will see in the workplace. For example, they need to use printed circuits in place 
of “breadboards.” 

A. General Estimated training time: 50-70 hcnirs 

A.Ol Demonstrate an understanding of proper safely techniques for all 
types of circuits and components (DC circuits, AC circuits, analog 
circuits, digital circuits, discrete solid-state circuits, microprocessors) 

A.02 Demonstrate an understanding of and comply with relevant 
OSHA safety* standards 

A.03 Demonstrate an understanding of proper troubleshooting tech- 
niques 

A.04 Demonstrate an understanding of basic assembly skills using hand 
and power tools 

A.05 Demonstrate an understanding of acceptable soldering/ 
desoldering techniques, including through-hole and surface mount 
devices A.06 Demonstrate an understanding of proper soldcrless 
conr ctions 

A.07 . demonstrate an understanding of use of data bcK)ks and cre^ss 
reference/technical manuals to specify and requisition electumic 
components 

A. 08 Demonstrate an understanding of the interpretation and creation 
of electronic schematics, technical drawings, and flow diagrams 
A.09 Demonstrate an understanding of design curves, tables, graphs, 
and recording of data 

A. 10 Demonstrate an understanding of cedor codes and other compo- 
nent descriptors 

A.l 1 Demonstrate an understanding of site electrical and environmen- 
tal survey 

A. 12 DemiMistratc the use of listening skills or assistive dev'ices lo 
assess signs and syniptoms of malfunctions 

Example 3, 

Author: Center for Occupalic'ina! Research and Development (CORD) 

Title: National Photonics Skill Standards for Technicians 
Source: Pittsfield, MA: Laurin Publishing Co., 1995 
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Accessories: 

1. E^O MODULATORS AND Q^SWITCHES Clean, maintain, align, 
mount, install, operate and demonstrate E-O modulators and Q-'Switches. 

2. A-O MODULATORS AND Q-SWITCHES Clean, maintain, align, mount 
and install A-O modulators and Q-switches, 

,3. MECHANICAL DEFLECTORS AND SCANNERS Clean, maintain, 
align, mount and install mechanical detketors and scanners. 

Analysis, Testing and Measurement: 

4. POWER AND ENERGY METERS Clean, maintain, align, mount, install, 
operate, demonstrate, classify^ and identify' power and energy’ meters, 

5. MONOCHROMATORS Align, mount, install, operate, demonstrate, 
classify^ and identify' monochromators, 

6. MICROSCOPES Operate and demonstrate microscopes. 

7. SPECTRUM ANALYZERS Operate, demonstrate, classify' and identify 
spectrum analyzers. 

Detectors: 

8. SEMICONDUCTORS Calibrate, test, clean, maintain, align, mount, 
install, operate and demonstrate semiconductor detectors. 

9. DETECTOR ARRAYS Calibrate, test, align, mount install, operate and 
demonstrate detector arrays. 

10. DETECTOR AMPLIFIERS Calibrate, test, clean, maintain, align, mount, 
install, operate and demonstrate detector amplifiers. 

1 1 . CCD/CID Calibrate, test, align, mount, install, operate and demonstrate 
CCD/CIDs. 
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Appendin B 

State Directors of Vocational 
Education 1999 



http://\vw\v.iris.orij/'~nasdvr.cc/dircctors.html 



/Mahama 

Hr. Nanc\’ 1 I 

Alaska 

Ms. Rarhara I hnmpMm 907 465-8704 

ArinMia 

NR. Marv Lc\'> kowii: (>02 5-l2'5.]l2 
Arkansas 

IV. Stcplu'ii B. kranks 501 682-1500 
Claliti^riiia 

Mr. Smart Circentcld 916 657-2552 
( A)loraJo 

Ms. C'hrisiinc ]ohnM‘n K' 5 620-4000 )OKs25- 
4295Uax) 

CAmncciiciU 

Mv Rolvrra r.iwloski v860 65S-4000 
Hchns arc 

IV. I.cwi.s 1., Atkinsiai k^2 7?9.-|658 
MnriJa 

Mr. Joseph StcpluMis 850 488-7591 

C icor^’ia 

Ms. Sus.u'i Pohrm.mn 404 656-5698 
I lawaii 

! ’'r. K.n l.i Jones 808 95(^7461 

Idalio 

Pr. Miko Rush 208 P4 52 I 

Illinois 

Ms. Pia.na. h, Rohinsdn 21 7 782-4870 

liKli.ina 

Mr. Icrrvl-kVh 517 2 52-1829 
lok ,! 

Pr. IltOu C jarev 515 281-5542 



Kansas 

Pr. Mcrlvnc Hincs-8tarr 785 296-5951 
KLTinicky 

Mr. Hinil Jerik 502 564-4286 
L(Miis<ina 

Pr. I-lorciu IlaidN 504 542-5526 
Maine 

Mr. Chrisre.pher P. Lvons 207 287-002 5 
Maryland 

Ms. Katharine M. Oliver 410 767-01 58 

Massachiiseits 

Mr. IVancis Kane 781 588- 5 500 (exi. 45 1 ) 
Michi^ian 

Mr. John Williams 5 1 7 57 5- 5 575 
Minnesota 

IV. LVena Allen 612 296-81 1 5 

Mi.ssjssippi 

Mr, James Sardin 60i 559-5486 
Missouri 

L5r. Russcll Met '.imphell 57 5 75 1 -2660 
Monia.na 

Pr. .Arlene Parisot 406 444-0516 
Nebraska 

Mr. Riehard C'amphell 402 471-4808 
Neviid<i 

Ms. Phvilis Rkh 702 687-9190 
New Hampshire 

I^'r. X’ir^ima tV[5rien Irwm (0 5 271-5890 
New Jerse\ 

Pi. I houias A. 1 Ienr\ 609 655-0665 
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New Mcxilo 

Ms. Carolyn Luck 505 i^27'65l2 
Now Ytirk 

M>. ]c<in Sreven" 5 474-8S'">Jl 
North CJar(4ina 

IV. Jliik‘ Atkinson ^ I 715- 162h 
North Dakotit 

Nir. Mo! Olson 701 5280250 
Oitio 

Hr. Joanna Kister 614 46604^0 
6">kIahonia 

Pr. Ann Benson 405 7450444 
C5rc^'tm 

Pr. RimalJ L. Lumper 505 578- 5584 ext. 550 

Ponnsvlvaiiia 

I5r. Thomas W 'inters 717 78705 50 
Rhode Island 

Ms, \anessa C^udev 401 222-4600 ext. 2 160 
South C'andina 

Pr. janu*> R. CiMich, Jr. SO 5 754-S410 
South Pakot.i 

Mr, Patriek Keatinsj 605 77 5-4527 
fennessce 

Ms. Beckv Hedrick Kent ol 5 5 52-2M 5 



Texas 

512 065-2224 
Utah 

Mr Rolvn O. Bivnis ^01 5 5S-7S41 

\'erm on I 

M>. Kathy Finek 802 828-5144 
X'ir^inia 

Pr. Neils \x: Brooks 804 225-2847 
Wasliiiiyion 

Ms. Ellen C5’Brien Saunders 560 75 5-5660 
West Virginia 

Mr, .Adam J. Sponaii^le 504 55S-2 546 ext. 5 
W Won sin 

Mr. Edward CTin 608 266-1770 
W yominjz 

Ms. Relx'cca Walk 50^ / M-r4P 

PisiricL ol Col urn hi a 

Pr. CAnthia M. Bell 202 576-6 508 

Puerto Rico 

Mr. Cark>s X’astjue: 787 758-41 52 
X’iruin Nands 

Ms. Ann.i Lewis 540 776-54v8-l 
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Appendix C: Model Scenarios 

Model Scenario 1 

Scenario Title: Applying for a Job 

Skill Standards/Tasks Included in the Scenario: 

A 1.4 Use correct spelling 

A 1.5 Write with accuracy, brevity, and clarity 

ELZ Organize materials with a logical flow 

E9.8 Prepare a resume and letter of application of interest 

A 1.6 Keyhoarding 

Workplace Context/Situation: A friend of yours saw an announcement for an 
entiy' level industrial maintenance hourly employee at Ace Manufacturing, 202 
West 2nd Street in Brandon, KY. Since you will be graduating from your techni- 
cal program within the next two weeks you are actively seeking employment that 
matches your skills and abilities. Write a letter of application for this position to 
John Smith, Human Resources Director and attach a resume. 

This ycenario requires approximately 1 hour to complete. 

Scenario Set-up Directions for the Instructor: 

Provide students with a computer and software to develop their letter and 
resume. 



Performance Criteria/Assessment Rubric/Checklist: 

tlic tnlhnnny duvkhst u> ovaluaic tlio pciinminnoo. ;in “X” in tlio <.nliimn t( 

the iW c.jlIi step to th:u the NtnJent passeJ, 

Performance Passed 



Pro 


pared one application 


letter keyed w 


ithout error 




Inci 


1 tided key points of jol 


inhirmaruMi ii 


n letter: 






Name aiKl tldLl^es^ 


ot prosj"ieeri\'e 


emph wer 




h. 


SiatL'incnt ot in ten 


.*M in job 






e, 


Inlonnarion abmit 


student inelikl 


ing name, .idLlre.y 


H. .ind 




methtvl ol eianaer 








Pro 


pared a resume keved 


without error. 






Stu 


dent inlormaiiiai w.is 


eorreet and aj^ 


plieable to j(b 




req 


uiremenls. 


















Model Scenario 2 



Scenario Title: Attendance and Being on Time is Necessary to Get the Job 
Done 

Skill Standards, Tasks Included in the Scenario: 

E^.2 DtKumcnr regular attendance 

E9.1 Demonstrate consistently punctual arrival 

Workplace Context/Situation: 

You are an employee of Ace Manufacturing as an entiydevcl worker in the plastics 
Jix ision. ou are wc^rking with a fivcmiember team that has been assigned the task 
of evaluating a new piece of equipment. Within the next 3 days, the team must 
present, in writing, a consensus on the \'ali:c of this equipnaent to your operation. 

One ot the team members, Jim, has only reported to work two of the last 6 days 
during this equipment evaluation. Another tcan'i member. Julie, has been late to 
work 3 c^f the 6 days and, thus is not aware of the full operation of neither the 
equipment nor its advantages and disadvantages. If the equipment is purchased, 
Jim will he the person ultimately resptmsiblc fc^r operating it because ot his skills 
and seniority in the department. 

Il you were the team leader, describe the process you would use to complete this 
report by the due date. In addition, write a letter to ycnir supervisor describing the 
cttccis irregular attendance and punctualin’ on the company. In the letter list at 
least three benctits and three consequences that can result trom poi^r attendance 
or punctualirN’. 

This scenaric^ requires approximately 45 minutes to amiplete. 

Academic Skills Required (Math, Language Arts, Science) : 

A 1 .4 Use correct spelling 
A 1.5 Write with accuracy, brevity-, and clarity* 

.A1.7 Knowledge ot conflict and resolution techniques 

Workplace Skills (teamwork etc.)i 
E1.5 Understanding team concepts 

AA1.3 Contrast the nfles ot a team with the role ot an individual 
Scenario Set-up Directions for the Instructor: 

Prox'idc compuicr <ind software tor rvping letter 
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Performance Criteria/Assessment Rubric/Checklist: 



Student described the task to be completed, the status of this task, complications 
and a process that would achieve the desired results within the time period. 

Letter to supervisor was keyed without error. 

Letter to supervisor included three benefits of maintaining regular attendance and 
punctuality 

Letter to supervisor included three consequences if regular attendance or punctin 
aliry is not maintained. 

Letter to supervisor was written with brevity', clarity, and accuracy. 
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Scoring Rubric: 



1= Novice (Not Competent) 


2= Apprentice (Unacceptable) 


1 . Process addresses starie ot the 
issues. 

2. Letter to supervisor was wrinen 
but contained erre^rs and did not 
include appropriate benefits or 
consequences. 


1. Process was briefly described but did 
not deinonstraro imporrance of achieving 
results in desired time frame. 

2. Lerrer ro supervisor contained errors. 

3. Letter to Miper\’ist)r had only two 
henefirs and cwo consequences listed. 


3= Proficient (Minimal Competence) 


4= Distinguished (High Mastery) 


1. PuKoss was described biii would nt)t 
achieve resulrs in original time [vriod. 

2. Letter xo supervisor w’as keyed wirlv 
out error. 

L Letter lo siiper\ isor included three 
henelits of maintaining regular atreii' 
dance and punctuality 
4. Letter to supervisor included three 
consequences when regular attenilance or 
punctuality' is not maintained. 


1. Process was described to achieve the 
desired results within the time period 

2. Letter to supcr\asiM‘ was keveLi without 
error. 

L Lellcr to sup-erviscu included three 
benefits of maintaining regular attendance 
and punctuality 

4. Letter to supervisor included three 
consequences when regular attendance or 
punctuality is not maintained. 

5. Letter to supcr\*isor was written with 
hre\’ity, clarip*, and accuracy. 
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Model Scenario 3 
V^TECS 

Virtual Training & Education Sclnario' 

Prototype 

Manufacturing Linkage ^^CORE RESPONSIBILITY” Duties and Tasks: 

0. 1 ESTABLISHING CUSTOMER NEEDS 

LI. 2 Review and document customer product specifications and other 
requirements using quality-planning tools. 

2.3 MANAGING QUALITY SYSTEMS 

2.3.1 Ensure that the manufacturing system meets quality system 
requirements defined by the business (e.g., QS9000, ISO 90Q0, and 
other customer and stakeholder requirements). 

2.4 IMPROVING MANUFACTURING PROCESSES 

2.4.1 Use company problem- solving systems to continuously impren'e 
manufacturing operations. 

Required Academic Skills: LA L 2, 3, 4; MA 3, 6. 10. 11 ; SC 042, 280, 338, 
499, 503 

NOTE: The al)lflic{ihlc suite's cicuJemic coiiiem suiiulanls could he disliLiyed here if the suite 
stiimlards uvre cwssmdked to the \-TECN Skill Taxouomy 

V^TECS Workplace Skills: DOOl, 004; H 001, 003; M004 

Related NACFAM Manufacturing Standards: BO 6, 7, 11; PC 2; \VI 7; WH 
2, 5, 8, 10; QA 1. 2, 3, 5, 6, 9, 10, 11, 12, 14, 16, 17, 18, 19, 20; MF 1, 2, 3, 4, 5, 
15, 16; PS 2, 3,; CT 2,4, 5,9, 13, 14, 15, 17, 19, 20, 21, 22, 24, 26; MM 1, 2, 3, 
4,6,20,22; CU5, 8; WS6, 7, 13, 18,21 

Related O'^NET Code: 83005A 

Related North American Industry Classification System (NAICS) Code: 
325510 



Conditions of Performance: 

Given the following: 

Company procedures for making quality checks 
Documentation on previous audits or results of company procedures 
Process control documents or test results of a specific quality check 
Product specifications 

Standard forms, charts and materials tor recording findings 
Summary of Performance: 

Utilizing data available to you, conduct an internal review for a production unit to 
determine its compliance with the company’s quality’ sysicm. Participant is 
required to use a standard industry' model to conduct the review and present 
findings. A Q 



Performance Criteria: 

Evidence was presented that the participant had completed the following steps for 
conducting a review and presenting findings: 

1 . Reviewed any previous audit information 

2. Compared pre -audit information to departmental and company processes and 
requirements. 

3. Monitored/reviewed current process as compared to written procedures 

4. Charted or documented findings. 

5. Considered various alternatives for correcting any problems. 

6. Determined best corrective action and recommended a plan of action that 
includes timelines, personnel assignments and costs. 
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Student Instructions: 



You are an employee of Pretty' Paints. You have received numerous calls from 
customers indicating that Paint listed as Catalog No. 12345 is too thick and 
difficult to use. You have been asked to conduct a pre-audit of compliance with 
the quality procedures for the sampling of paint prior to filling. You have been 
given results of three tests made on this batch prior to filling and the formula with 
specs for that particular paint. In addition you have been given the procedures 
that are to be followed in checking for the quality' of all paint products. Deter- 
mine if the procedures were followed and document your findings and recommen- 
dations for correcting any problems in a letter to Mr. John Smith, the Qualit\^ 
Department Manager. 

Teacher Instructions: 



To set up this activity, you will need to provi(Je student with the following infor- 
mation: 

• Attached sheets giving test results of quality' checks on paint 

• Attached Formula and Spec Sheet 

• Attached Company Procedures for conducting quality' checks 
Assessment Criteria: 



Successful completion of the scenario includes the following: 

1. A memorandum was uTitten to Mr. John Smith that identifies that procedures 
were not followed. 

2. The memorandum states that two tests did not conform to .specs: 

a. viscosity' above range, and 

b. weight per gallon above requirements, (The higher the N'iscosity the 
thicker the paint.) 

3. The memorandum states that the paint was produced and adjustments were 
not made, either on the production line or in the formula, to correct the higher 
viscosity and the weight per gallon. 
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4. Recommendations are suggested tiiat: 

a. results should he cdosely reviewed by both quality technician and by 
line supervisor prior to production; 

b. if test results are out of compliance with specs, then the lab and 
line supervisor should decide if they can make corrections and retest or 
do they need to notify' developer ol formula of problems so adjustments 
in formula can be made; and that 

c. written procedures are followed, or if needed, modifications are 
made in written procedures to conform to process being used. 

5. Satisfactory performance on the associated writtei'i perfc^rmancc assessment. 

Resource used in development of scenario: 

Eric Pettv', Quality' Technician, ICI Paints, Cleveland, OH 

Procedures for Paint Quality Control Tests Prior to Production 

1. Fill pint can with sample of paint, which has been prepared according tt^ 
formula and specification sheet for filling production. 

2. In quality' control lab, pull Formula Inquiry and Specification Sheet that 
describes the test description and instructions for running all tests on sample 
for this specific product. 

3. Input into computer descriptive data about product such as catalog, formula, 
date, and hatch number. 

4. Run all tests as defined on Specification sheet. 

5. Input results each test in computer data about that sample. 

6. Let paint sit overnight. 

7. Run a second viscosity test and input results. 

8. Printout results of tests and compare to Product Specification Sheet. 

9. Make written comments about any results out of compliance with 
Specification Sheet. 

10. Send copy of rest results to Production Supervisor. 

1 1. Discuss with Production Supervisor options for correcting or retesting. 

12. If after two retests are performed, and results still indicate prculuct is out of 
compliance with specifications, then meet with prc)duct developers and ha\’e 
product rechecked at developing lab to see if specs or formula need to he 
changed. 

13. If specs and formula are okay, then a review of the production process needs 
to he reviewed and any adjustments in this process must be made to meet 
product specifications. 

14. Continue to retest until sample meets product specifications 




TEST RESULTS 



Pretty Paints Form 1 1 1 
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12345 M FT3 SPFXnFICATIONS 



Payc I of 1 



Catalog 12345 
Foimula FT3 
Date 1 1/08/97 
Batch 4789 
TDatc F 
Tank 

Theo Yield 900 
Tank Yield 900 



Viscosity 


WT/GAL 


GRIND 


GLOSS 


SAG 


PH 


75-85 


11.00 


P 


P 


40-60 


7.5-S.5 


92 

2nd Viscosin>' 
105-110 
113 


11.42 


P 


P 




7.5 



PRE-ADJUSTMENTS: 
Additions and (foinmcnts: 



User ID Smith Location 345 

Date; 10/18/98 




52 







■MMKI 

I Appendix C 



TEST SPECIFlCA'nON 



) j .!! 

Mininuim K In ^ i JIUID i 

75 

105 110 

10.50 11.00 

PASS 
P/\SS 
PASS 



S.5 



j i'.V.l InsiriK ti(^n 
Nl \'iM;osirv 

OvciiiiaPl .-iiJ \'isc( inIu 

W'ui^hi Per C Jill Inn LHS C jAL 

( il^»^^ \ or Ivlow 

ni\V IiMI:-l luHir lo rniicli 

TPXTPRP: (Ciriml Itiumk-ss) SMOOTH 

S/\0 40-O0 

pi I Moasiiremoni 
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Appendix D 

Instructional/ Assessment 

Scenario Criteria 



1 . Identifies the industry skill (s) included in the scenario 

0 = the industn' skill (s) included in the scenario arc not specified 
4 the industry skill (s) included in the scenario arc definitive and 
ineasurahle 

2. Identifies the workplace context of the scenario 

0 = the context of the scenario does not reflect a realistic workplace 
4 = the context is realistic as stated in the scenario 

3. Describes the problem to be solved in the scenario 

0 the sccnarit) problem is not clear or is trivial 

4 = a problem is clearly stated, of substance, and the learner has no 

questions 

4. Identifies the time allocated for performance 

0 “ no performance time is listed 

4 = aiiKnmt of time allowed for performance is clearly stated 

5. Identifies and lists the academic skills required to perform the scenario 
competently 

0 = no academic skills are identified 

4 = the state academic content standards reinforced are identified 

6. Includes the workplace skills required for scenario performance 

0 “ no workplace skills arc identified 

4 includes skills and as, 'ssment rubric for the ncccssan/ skills 

7. Includes instructions to the instructor or performance evaluator 

0 “ no instructions arc included 

4 “ scenario seMip and performance evaluation instructions arc clear 
and unambi^iR^us 

8. Criteria of proficient performance arc listed and unambiguous 

0 = no performance criteria is identified 

4 = performance criteria or assessment rubrics are listed and clear to 
learner 

9. Scenario is gender, culturally, and racially neutral 

0 = includes references, terms, or words associated with gender, 
ailuirc, or race 

4 = no references, terms, or words associated with gender, culture, or 
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Appendix E 
Scenario Planner 



Scenariu Title Production Planning Date July 30, 1999 

Skill Standards/Tasks Included in the Scenario (List); 

« Control quality manufacturing system with other manufacturing systems. 

® Identify effects of quality’ systems on specific manufacturing processes. 

• Explain the effect of quality on profit, 

• Locate and retrieve production materials specific to process flow and delivery 
schedule, 

• Receive and communicate process flow instructions and deliver schedules. 

• Apply a system of problem solving. 

• Identify opportunitii^s for applying problem-solving techniques. 

Workplace Context/Situation: 

Yuli lire an employee oi Drinks, Inc. It is your job to order supplies and plan production 
to meet the needs of your customers without having too much tm hand as rhe humidity 
in Florida will damage any o\'erage that sits for longer than 2 weeks. A new employee 
diLl not realize that Owen’s Food Market is on a continuous replenishment plan and 
therefore, it went unnoticed on the CRT that Owen’s Food Market, one of your biggest 
cu'^tomers, is extremely low in in\'enti^r\-. To complicate matters, the marketing depart- 
ment has just announced that a hig piromotion will take place on the 14 ounce hiKtlcs 
within the ne.\t four weeks at Surry’s, another grocery chain. This promotion will 
require special labels and twice the number normally supplied to Stoiy’s. You call a ream 
meeting to discuss t^ptions for meeting both customers needs within their desired 
timelines and without a significant amount of unused material. DeveK^p a plan for 
pnvluaion that meets both customers nee(.ls as well as m^rinal scheduled production. 



This scenario recjuires approximately 9 hours to complete. 

Academic Skills Required (Math, Language Arts, Science): 

• Add, subtract, multiply and divide four digit numbers with the use of a 
calculator. 

• Add, subtract, multiply, and divide four digit numbers without the use oi a 
calculator. 

• Apply basic math functions to solve problems. 

• Create and interpret basic graphs and charts commonly used in manu- 
facturing. 

Workplace Skills (teamwork etc.): 

• DemiMistratc the ability to act in a pcditc and respectful way toward ciw 
workers. 

• Demonstrate the ability to complete tasks on tinie and aceuralcly. 
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• Fcillow directions and prt)ccdurcs. 

« Demonstrate a willingness to work. 

• Plan and organize work. 

Instructor/Evaluator Instructions: 

To set up this activity, you will need to divide the students inu^ teams and proviele 
each team with the follov\-ii'ig informarkm: 

• Finished Lnventor\' of three different flavors on hand at this plant 

• Current and projected finished inventor' for Owen’s Fo)od Market 

• Number required for the promotion 

• Capacity of line and equipment; potential line utilization reports/data 

• Shipping records; order fill rate; on time delivei^ reports; shipping/ileliveiA' 
stats 

® Normal run schedule for production 

® Line reliability schedule — preventive maintenance, flavor changes, history ol 
unscheduled down time 

• Staffing schedules 

• Vendor information: list of vendors v/ith histor\^ of delivery sL*as; costs of 
materials; quantity available for various prcxliicrs 

• Package material and ingredient inventor^’ on hand 

• Company policies and procedures, guidelines (costs data, labor guidelines, 
quality’ issues, etc.) 

• Order forms and inventory control records 

Each ream should develop a plan that meets the customer needs within C('>mpany 
guidelines. 

Performance Criteria/Assessment Rubric/Checklist: 

Product Plan developed that meets customer specs within company policies and 
regulations. Plan is developed by completing the following steps: 

1. Current inventory' of materials (finished and packaged materials and ingre^ 
dients) is accurately determined. 

2. Number to be produced is accurately projected. 

3. Orders are placed accurately reflect material lead times for pn^duction 
schedule. 

4. Changes are identified in the producticMi schedule to reflect a\’ailahility nf 
packaged materials and ingredients and required output. 

5. Compliance with company policies for costs, labor, materials, 

6. Allowances made for equipment maintenance, any holidays, shipping sched- 
ules or other possible delays 

7. Recommended alternatives as needed. 

8. Plan meets customer needs without more than m'crage than can he safely 

steered in existing finished inventory’ for shipment and any extra packaged 
materials and ingredients can he safely stored and used within time specified 
by product specs. ^ (j 

S4 I Development Team: 
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Scenario Title 

Date 

Skill Standards/Tasks Included in the Scenario (Lust): 



Workplace Context/Situation; You work at 
as an entr^'devel worker. Your job title is 



This scenario requires appreuximatcly 



to complete. 



Academic Skills Required (Math, Language Arts, Science): 



Workplace Skills (teamwork etc,): 
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Scenario Set-up Directions for the Instructor: 



Performance Criteria/Assessment Rubric/Cliecklist: 



Development Team: 




Using National and State Shill 
Standards for Vocational- 
Technical Education Curriculum 
Development 

by Charles L Losh 



Offers guidelines for determining the usefulness of 
national and state skill standards for vocational- 
technical education curriculum development. Shows 
how to use standards'based scenarios for instruction, 
using a scenario planner. 



L Order No. IN 3BS^ $8^0 



Ordering Information 



To order additional copies, please use order number 
and full title of publication. Orders should be made by 
school/agency purchase order, letterhead, or prepay- 
ment. Personal orders must be prepaid. Make remit- 
tance payable to the Center on Education and 
Training for Employment. Mail order to: 

Center on Education and Training for Employment 
Center Publications 
1900 Kenny Road 
Columbus, OH 43210-1090 

Phone: 614/292-4277 

Toll Free: 800/848-4815, ext. 24277 

Fax: 614/292-1260 

Web: http://cete.org/products/index.html 

Full payment is due 30 days after receipt of materials 
and invoice. All payments must be made in U.S. 
dollars. 



Credit Cards 

To charge your purchase, indicate either VISA or 
MasterCard and provide card number, expiration 
date, amount to be charged, name as it appears on 
card, telephone number, authorized signature, and 
the current date. 

Quantity Discounts 

Orders of 10 or more items, as listed by publica- 
tion number and title, with a total dollar value for 
the order of: $201 to $300, the discount is 5%; 
$301 to $400, the discount is 10%; $401 and 
above, the discount is 15%. 

Shipping and Handling 

Prices include standard shipping and handling by 
the best direct method within the continental 
United States, Priority and internniional ship- 
ments will be charged at actual shipping costs plus 
a $5 handling fee. Prices listed are in effect at the 
time of publication of this hook. Prices are subject 
to change without nonce. 
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